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Abstract of JP9265378 

PROBLEM TO BE SOLVED: To provide a 
supporting method and device capable of 
judging the mental state of an operator for 
performing operations by voice input and 
performing operator supporting suited to the 
mental state. SOLUTION: In a voice 
recognition processing part 3, the pattern of 
the instruction word of a plant operation voice 
inputted beforehand is registered for each 
operator. During the operation, for a voice 
instruction word from a microphone 6, the 
sound pressure waveform is fetched through a 
data conversion part 2 to the voice recognition 
processing part 3 and a maximum sound 
pressure, a highest frequency and shortest 
sounding time are fetched to an operator state 
judgement processing part 4. The voice 
recognition processing part 3 divides the 
sound pressure waveform and performs 
spectrum conversion for respective sound 
pressure data and performs the voice 
recognition of the instruction word by pattern 
matching. Also, the operator is specified by 
speaker recognition. The operator state 
judgement processing part 4 compares the 
inputted maximum sound pressure, highest 
frequency and shortest sounding time with the 
registration data of the specified operator 
respectively and judges the mental state. A 
supporting processing output part 5 executes a 
supporting processing corresponding to 
instruction contents when the mental state of 
the operator is 'abnormal'. 
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[0029] 

Generally, when the operator is in an abnormal mental state by 
strain or the like as compared with a usual mental state, the sound pressure 
of a voice word is large, frequency is increased and sounding time becomes 
short. However, since there are individual difference and an error due to a 
surrounding state, in the embodiment, double of the maximum value of the 
sound pressure at usual time, 10% of the maximum value of the frequency 
at normal time, and decrease by 30% of the average hour of the sounding 
time at usual time are respectively set to a threshold value. The output (l) 
showing "abnormal" is performed when exceeding the values, and the output 
is not performed otherwise (0). A mental state judgment part 45 inputs the 
output of each of comparing parts 42 to 44. If there are inputs of two or 
more, the mental state judgment part 45 judges as "operator state: 
abnormal". A specific output such as sound pressure comparison may be 



used as a necessary condition. 
[0030] 

Next, a supporting processing output part 5 performs an output 
process as the voice instruction received from the voice recognition 
processing part 3 if the judgment result of the operator state is "normal" 
(sl08). On the other hand, if the judgment result is "abnormal", a plant 
state is judged based on a predetermined data of a plant state detecting part 
(sl06). If the plant is normal, a process advance to sl08, and the output 
process as the voice instruction is performed. However, when the plant is 
abnormal, the supporting processing of the corresponding predetermined 
content is performed with reference to an operation registration file 53 
(sl07). 
[0031] 

The content of the supporting processing depends on the constitution 
and dynamic characteristics of the plant. For example, when the plant 
comprises a system 1 and a system 2, and the system 1 is abnormal, it is 
registered in the operation registration file 53 that "a valve 1, a valve 2 and 
a valve 3 are closed in this order at the time of the abnormal of the system 
1". When both the system 1 and the system 2 are normal, the content of 
processing "close the valve 1" as the instruction of which the voice is 
recognized is outputted to the operation end of the valve 1 via PI/08. 
[0032] 

On the other hand, when the operator's mental state is judged to be 
"abnormal" and the abnormal is generated in the system 1, "the valve 1, the 
valve 2 and the valve 3 are closed in this order" of the operation registration 

2 



file 53 is referred, and after the output of "close the valve 1", "next close the 
valve 2" is directed to the monitor. Since "error of instruction" can be 
confirmed by reference of the operation registration file 53 if the voice of the 
instruction at this time is recognized as "input the system 2", the input 
about the system 2 is forbidden while directing "close the valve 1" through a 
monitor or a speaker. Furthermore, it is also possible to guide "settle down 
and operate as directed" or the like to the operator. 
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